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(54) METHOD AND DEVICE FOR THREE-DIMENSIONAL INPUT 

(57)Abstract: 

PROBLEM TO BE SOLVED: To realize a compact 
three-dimensional input device which provides high 
resolution. 

SOLUTION: Pulse light is projected on an object, 
reflection light from the object is received by a 
photographing area sensor consisting of a plurality of 
photoelectric transfer elements, light exposure control 
of the photographing area sensor is done with a timing 
with the projection of pulse light, and a distance is 
measured by each photoelectric transfer element based 
on an output of the photographing area sensor. 
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CLAIMS 



[Claim(s)] 

[Claim 1] It is the three-dimension input approach which measures the distance to 
two or more locations on an object object by projecting light and receiving the 
reflected light from an object object. Project pulsed light on an object object and the 
reflected light from an object object is received by the image pick-up area sensor 
which consists of two or more optoelectric transducers. The three-dimension input 
approach characterized by performing exposure control of an image pick-up area 
sensor to the timing which synchronized with projection of pulsed light, and 
measuring distance for every optoelectric transducer based on the output of said 
image pick-up area sensor. 

[Claim 2] The three-dimension input approach according to claim 1 which measures 
distance for every optoelectric transducer based on the output of said image 
pick-up area sensor when carrying out exposure control so that light exposure may 
be dependent on an optical travelling period, and the output of said image pick-up 
area sensor when carrying out exposure control so that light exposure may not be 
dependent on an optical travelling period. 

[Claim 3] The three-dimension input approach according to claim 1 of performing 
exposure control so that a pulsed light projection period and an exposure period may 
be in agreement. 

[Claim 4] The three-dimension input approach according to claim 1 which carries 
out exposure control so that multiple times may be exposed to different timing to 
one projection. 

[Claim 5] The three-dimension input approach according to claim 1 which carries 
out exposure control so that multiple times may be exposed within a pulsed light 
projection period. 

[Claim 6] A light transmission means to be the three-dimension input unit which 
measures the distance to two or more locations on an object object by projecting 
light and receiving the reflected light from an object object, and to project pulsed 
light on an object object, The image pick-up area sensor which consists of two or 
more optoelectric transducers which receive the reflected light from an object 
object, The three-dimension input unit characterized by having a means to remove 
the light-receiving variable component on the strength by the distance or the 
reflection factor of an object object from the controller which performs exposure 



control of an image pick-up area sensor to the timing which synchronized with 
projection of pulsed light, and the light exposure obtained by exposure control. 
[Claim 7] The three-dimension input unit according to claim 6 which performs 
exposure control so that a pulsed light projection period and an exposure period may 
be in agreement. 

[Claim 8] The three-dimension input unit according to claim 6 which carries out 
exposure control so that multiple times may be exposed to different timing to one 
projection. 

[Claim 9] The three-dimension input unit according to claim 6 which carries out 
exposure control so that multiple times may be exposed within a pulsed light 
projection period. 

[Claim 10] The three-dimension input unit according to claim 6 which amends 
measured value according to the light exposure of the pulsed light which has the 
internal optical path which leads pulsed light to at least one optoelectric transducer 
in said image pick-up area sensor from said light transmission means, and spread 
said internal optical path. 

[Claim 1 1] The three-dimension input unit according to claim 6 with which the mode 
of operation which has an optical means for switching the illumination distribution in 
a projection field, projects the light of the 1st illumination distribution and the light of 
the 2nd illumination distribution in order to an object object, and measures distance 
for every optoelectric transducer based on the output of said image pick-up area 
sensor in the 1st projection and the output of said image pick-up area sensor in the 
2nd projection was prepared. 

[Claim 12] It is the three-dimension input approach which measures the distance to 
two or more locations on an object object by projecting light and receiving the 
reflected light from an object object. The light of the 1st illumination distribution and 
the light of the 2nd illumination distribution are projected in order to an object object. 
The output of said image pick-up area sensor [ in / the light reflected with the 
object object in projection of each time is received by the image pick-up area 
sensor which consists of two or more optoelectric transducers, and / the 1st 
projection ], The three-dimension input approach characterized by measuring 
distance for every optoelectric transducer based on the output of said image 
pick-up area sensor in the 2nd projection. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the three-dimension input approach 
and equipment which acquire objective positional information by projecting light and 
receiving the reflected light. 
[0002] 

[Description of the Prior Art] A three-dimension input can be performed using the 
time of flight (TOF:time of flight) to reception of the pulse which reflected and 
returned from transmission of the pulse of light by the body being dependent on 
distance. 

[0003] The equipment configuration which modulates the light which carries out 
incidence to an image pick-up area sensor with an electrooptical modulator in the 
Patent Publication Heisei No. 508371 [11 to ] official report, using an image pick-up 
area sensor (two-dimensional image sensors) as a light-receiving device is indicated. 
Distance is reflected in the light exposure of an image pick-up area sensor by 
performing the light-receiving modulation which synchronized with floodlighting. By 
asking for a ratio with the light exposure when not becoming irregular with the light 
exposure when becoming irregular, the distance information to a body can be 
acquired irrespective of the reflection factor of an object object. By using an image 
pick-up area sensor, it is more possible than the case where an optical path is 
deflected by the scanner to perform much ranging (namely, three-dimension input) 
of a point at a high speed. 

[0004] Moreover, to JP,10-332827,A, fixed-ize the quantity of light of the reflective 
pulsed light which repeated projection of pulsed light the fixed period and returned, it 
is made to carry out incidence to an image pick-up area sensor, and the equipment 
configuration which measures the light exposure in a predetermined period is 
indicated. Light exposure is proportional to the number (pulse number) of reflective 
pulsed light, and, as for a longer long distance, there is less time of flight. By 
fixed-izing the quantity of light of reflective pulsed light, the three-dimension input 
independent of the reflection factor of an object object is attained. 
[0005] 

[Problem(s) to be Solved by the Invention] Since the light modulation device needed 
to be incorporated with the configuration which controls the exposure timing of an 
image pick-up area sensor by light modulation as mentioned above, the 
miniaturization of equipment was difficult. With the configuration which fixed-izes the 
quantity of light of reflective pulsed light, a measurable range and the tolerance of 



an objective reflection factor were restricted by the engine performance of the 
optical means for fixed-izing, and there was a problem that resolution will be decided 
by the projective period. 

[0006] Moreover, also in conventional which configuration, since it was the method 
which detects the merits and demerits of time of flight based on light exposure, 
there was also a problem that it was difficult to perform highly precise ranging in a 
short-distance case. 

[0007] This invention is small and aims at implementation of the three-dimension 
input unit of a high resolution. Other purposes are aiming at expansion of the range 
which can input request precision. 
[0008] 

[Means for Solving the Problem] The distance to an object object is made to reflect 
in the light exposure of each optoelectric transducer by controlling the exposure 
timing of an image pick-up area sensor in this invention. For example, an exposure 
period is made in agreement with the luminescence period of the light source for 
irradiating an object object. The examples of representation of an image pick-up 
area sensor are a CCD sensor and an MOS mold sensor. A linear mold or a nonlinear 
mold (for example, a logarithm mold) is sufficient as the input-output behavioral 
characteristics. 

[0009] Moreover, the 1st and 2nd light from which luminous-intensity-distribution 
distribution differs is projected in order, and the distance to an object object is 
made to reflect in the ratio of the light exposure in the 1st projection, and the light 
exposure in the 2nd projection in this invention. This becomes computable [ the 
distance by the triangulation method ]. If a TOF method (TOF law) and a 
triangulation method are used properly, a highly precise three-dimension input can 
be performed over a larger range. 
[0010] 

[Embodiment of the Invention] [The 1st operation gestalt] 

[Configuration of equipment] drawing 1 is drawing showing the configuration of the 
three-dimension input unit concerning the 1st operation gestalt. (a) shows a whole 
configuration and (b) shows the configuration of an image pick-up side. 
[0011] The three-dimension input unit 1 has the optical system which consists of 
the light source 11, the floodlighting lens 12, a light-receiving lens 21, and an image 
pick-up area sensor 22. The light source 1 1 injects a laser beam in response to the 
electric power supply from the luminescence circuit 32. The object object Q is 
irradiated by the laser beam which passed along the floodlighting lens 12. Incidence 



of the reflected light from the object object Q is carried out to the image pick-up 
area sensor 22 through the light-receiving lens 21. The image pick-up area sensor 
22 has the pixel which shaded the light from the outside of equipment, and a part of 
laser beam carries out incidence to this pixel as a "criteria light" directly, without 
passing through the exterior from the light source 1 1 through the internal optical 
path 15 which consists of an optical fiber. Below, the pixel to which a "measurement 
pixel" and criteria light carry out incidence of the pixel to which a "measuring beam" 
and this measuring beam carry out incidence of the light which carries out incidence 
to the image pick-up area sensor 22 through the light-receiving lens 21 is called 
"criteria pixel." 

[0012] The image pick-up area sensor 22 operates according to the clock from the 
timing controller 33, and outputs the picture signal SG which shows the light 
exposure of each pixel which is a unit light-receiving field to the image-processing 
circuit 34. The image-processing circuit 34 performs a predetermined operation, and 
sends the ranging data DL obtained by that cause to the display 36 for the memory 
35 for record, and a monitor display. A system controller 31 generalizes the control 
in connection with the light emitting/receiving and signal processing in the 
three-dimension input unit 1. 

[0013] [Measuring method] drawing 2 is the explanatory view of a measurement 
principle. The light source carries out intermittent luminescence in response to the 
luminescence control signal which repeats ON/OFF by turns a fixed period. 
Exposure of an image pick-up area sensor is the intermittent exposure which 
synchronized with luminescence timing in the frame (n). Although luminescence 
timing and exposure timing are completely in agreement in illustration, as long as it 
has taken the synchronization, timing may shift and luminescence may differ in the 
die length (pulse width) of a period somewhat from exposure. 

[0014] Time t — a part of light (criteria light) which emitted light in 1 spreads an 
internal optical path, and it carries out incidence to a criteria pixel, the incidence of 
criteria light — Time t — it begins from t2 the time of the time amount Dref with 
which the time amount which spreads a luminescence time delay (offset time 
amount) and an internal optical path from 1 was doubled passing, the incidence of 
the measuring beam from an object object — Time t — it begins from t3 the time of 
the time amount D1 with which the time amount which spreads a luminescence time 
delay and an external optical path from 1 was doubled passing. Since exposure of an 
image pick-up area sensor is also stopped by t4 the time of luminescence stopping, 
the light exposure of the measurement pixel in one exposure takes the value 



according to the distance to an object object, and the reflection factor of an object 
object. In addition, the factor of the light exposure change depending on distance 
has the attenuation (reinforcement falls, so that it is far) of optical reinforcement 
other than the difference in the exposure time by incidence being overdue. If the 
reflection factor of an object object is known, it is possible to find distance based on 
light exposure. Measurable distance is decided by the die length of the period of one 
luminescence. An error can be reduced by performing many light emitting/receiving 
and finding distance based on total (stored charge) of the light exposure within an 
one-frame period within an one-frame period. 

[0015] However, it is difficult to get to know the reflection factor of each part of an 
object object beforehand in fact. Then, in a frame (n+1), exposure of an image 
pick-up area sensor is considered as continuation exposure. Thereby, the light 
exposure in a frame (n+1) mainly turns into an amount (reflection factor data) 
according to the reflection factor of an object object. Therefore, ranging data 
excluding the reflection factor component of an object from measurement data can 
be obtained by performing the next operation about each pixel of an image pick-up 
area sensor. Ranging data = measurement data / reflection factor data =[image data 
of frame (n)] / [the image data of a frame (n+1)] 

This operation is realizable by the image-processing circuit 34 of a configuration of 
being shown in drawing 3 . 

[0016] It quantizes by A-D converter 401, and the picture signal SG sent from the 
image pick-up area sensor 22 is outputted as image data DG. In a frame (n), image 
data DG (measurement data) is once stored in a frame memory 410. 
[0017] In a frame (n+1), if image data DG (reflection factor data) is outputted from 
A-D converter 401, synchronizing with it, image data DG of a frame (n) will be 
outputted from a frame memory 410, and an above-mentioned operation will be 
performed by the divider 420. 

[0018] Moreover, by performing the next amendment operation based on the ranging 
data of a measurement pixel, and the ranging data of a criteria pixel, the effect of a 
luminescence time delay can be removed and the distance to the object object of 
each measurement pixel can be measured more correctly. 

Ranging data [ after amendment ] = (ranging data of a measurement pixel) - (ranging 
data of a criteria pixel) 

This calculation function may be prepared in the image-processing circuit 34, and a 
system controller 31 may bear an operation. 

[0019] As a [example of image pick-up area sensor] image pick-up area sensor 22, 



whichever of a CCD sensor and an MOS mold sensor may be used. 
[0020] Drawing 4 is the explanatory view of a CCD sensor of operation, (a) shows 
structure typically and (b) shows control timing. The condition of tO, t1, t2, t3, and t4 
is as follows at each time. 

tO: The are recording of a charge by which photo electric conversion was carried out 
with the photodiode (PD) starts. 

t1: The gate SH1 is set to ON and stored charge moves to the gate SH1. 
t2: The gate SH1 serves as OFF and are recording of a charge starts in PD again. 
t3: Gate OD serves as ON and the charge accumulated in the period of t2-t3 is 
discharged from PD to a substrate. 

t4: OD gate serves as OFF and are recording of a charge starts again. 
By repeating the above actuation, the charge by which photo electric conversion 
was carried out to Period Ton is accumulated in the gate SH1 one after another. 
[0021] Drawing 5 is the signal waveform diagram showing control of the light 
emitting/receiving at the time of using a CCD sensor. Intermittent exposure which 
repeats actuation of drawing 4 R> 4 with a frame (n) is performed, and continuation 
exposure is performed with a frame (n+1). When the gate SH2 serves as ON at the 
time of frame termination, the charge stored in the gate SH1 in the frame (n) is sent 
to the transfer gate phiT1, and is outputted to the image-processing circuit 34 in 
parallel to exposure actuation of a frame (n+1). 

[0022] Drawing 6 is the explanatory view of an MOS mold sensor of operation. In (a), 
the outline of structure and (b) show migration of a charge, and (c) shows control 
timing. The condition of tO, t1, t2, t3, and t4 is as follows at each time. 
[0023] tO :P Are recording of a charge starts in the parasitic capacitance C1 of D. 
t1: Gate ST is set to ON and a charge moves from parasitic capacitance C1 to the 
capacitor C2 with a fully large capacity from it. 

[0024] t2: Gate ST serves as OFF and the charge storage to parasitic capacitance 
C1 starts again. 

t3: Gate RS serves as ON and the charge accumulated in the period of t2-t3 is 
discharged from parasitic capacitance C1 to power-source Rhine Vcc. 
[0025] t4: Gate RS serves as OFF and are recording of a charge starts again. 
By repeating the above actuation, the charge by which photo electric conversion 
was carried out to Period Ton is accumulated in the capacitor C2 one after another. 
In addition, since parasitic capacitance C1 is small compared with a capacitor C2, 
the potential of parasitic capacitance C1 rises greatly by are recording of a charge. 
When Gate ST is ON by this, a charge moves to a capacitor C2 from parasitic 



capacitance C1. 

[0026] Drawing 7 is the signal waveform diagram showing control of the light 
emitting/receiving at the time of using an MOS mold sensor. In drawing 7 , the frame 
(n) in PD11-PD14 which are shown in drawing 6 (a) is equivalent to t0-t6, and a 
frame (n+1) is equivalent to t8-t10. The frame (n) in PD21-PD24 is equivalent to 
t5-t7, and a frame (n+1) is equivalent to t9~t11. Moreover, the frame (n) in 
PD31-PD34 is equivalent to t6-t8, and a frame (n+1) is equivalent to t10-t12. 
[0027] Intermittent exposure which repeats actuation of drawing 6 with a frame (n) 
is performed, and continuation exposure is performed with a frame (n+1). As for the 
charge stored in the capacitor C2 with the frame (n), the signal with which the gates 
SL11-SL14 are equivalent to the charge of PD11-PD14 by being set to ON at the 
time of frame termination is memorized by the Rhine memory. The signal of 
PD11-PD14 which were memorized by the Rhine memory is a switch SV 1 - SV3. 
By turning on one by one, it is outputted to the image-processing circuit 34. 
[0028] Next, if a signal is similarly outputted about PD21-PD24 and a signal is finally 
similarly stored in the Rhine memory about PD31-PD34, the continuation exposure 
equivalent to the frame (n+1) about PD11-PD14 will be started, and the signal of 
PD31-PD344 will be outputted in parallel to continuation exposure. 
[0029] Since [cure against ambient light] ambient light is not dependent on the 
distance to an object object, the incidence of the ambient light of image pick-up 
area sensor 22 HE causes incorrect ranging. As a cure of ambient light, there is use 
of the light filter which makes the light of the luminescence wavelength region of the 
light source penetrate alternatively. However, in a light filter, ambient light cannot be 
removed completely. According to the example explained below, incorrect ranging by 
ambient light can be prevented. 

[0030] Drawing 8 is the signal waveform diagram showing the 1st modification of 
control. In a frame (n), while performing intermittent luminescence, intermittent 
exposure is performed to the same timing as luminescence. 

[0031] With a frame (n+1), the ambient light component of the light exposure in a 
frame (n) is detected by performing intermittent exposure, without emitting light. 
With a frame (n+2), in order to obtain reflection factor data, intermittent 
luminescence and continuation exposure are performed. 

[0032] And with a frame (n+3), the ambient light component of the light exposure in 
a frame (n+1) is detected by performing continuation exposure, without emitting light. 
Drawing 9 R> 9 is the block diagram showing the 1st modification of an 
image-processing circuit. 



[0033] Also in image-processing circuit 34b ? like the case of drawing 3 , it quantizes 
by A-D converter 401, and the picture signal SG sent from the image pick-up area 
sensor 22 is outputted as image data DG. 

[0034] In a frame (n), image data DG (measurement data) is once stored in a frame 
memory 411. In a frame (n+1), if image data DG (ambient light data of intermittent 
exposure) is outputted from A-D converter 401, from a frame memory 411, image 
data DG of a frame (n) will be outputted synchronizing with image data DG of a 
frame (n+1). The measurement data from which the ambient light component was 
removed by the operation in a subtracter 430 is obtained. The output of a subtracter 
430 is once stored in a frame memory 412. Moreover, in a frame memory 411, the 
writing of image data DG (reflection factor data) of a frame (n+2) is performed in 
parallel to read-out. 

[0035] If image data DG (ambient light data of continuation exposure) of a frame 
(n+3) is outputted from A-D converter 401, reflection factor data will be read from a 
frame memory 411, and the reflection factor data which removed the ambient light 
component from the subtracter 430 will be outputted. And the ranging data DL 
which removed the ambient light component are obtained by the operation in a 
divider 420. 

[0036] By the ranging approach of controlling [expansion of measurable range] 
exposure timing and making distance reflecting in light exposure, long-distance 
measurement with time of flight longer than a luminescence period (luminescence 
pulse width) cannot be performed fundamentally. According to the example explained 
below, long-distance measurement is attained. 

[0037] Drawing 10 is drawing showing the 2nd modification of control. With a frame 
(n), intermittent luminescence is performed and the same timing as luminescence 
performs intermittent exposure. With a frame (n+1), while performing intermittent 
luminescence, intermittent exposure of the timing which was overdue by the 
exposure time to the frame (n) is performed. With a frame (n+2), while performing 
intermittent luminescence, intermittent exposure of the timing which was overdue by 
the exposure time to the frame (n+1) is performed. And with a frame (n+3), in order 
to obtain reflection factor data, intermittent luminescence and continuation 
exposure are performed. 

[0038] For example, when the incidence of a measuring beam begins from t13 like 
illustration at the time within the exposure period (t12-t14) of a frame (n+1), the 
measurement data according to the travelling period D11 and D1V showing the 
distance to an object object is obtained on the both sides of a frame (n+1) and a 



frame (n+2). Such measurement data turns into ranging data with which the 
reflection factor component was removed by the division with the reflection factor 
data of a frame (n+3). An average with the ranging data obtained with the frame 
(n+1) and the ranging data obtained with the frame (n+2) is computed, and it 
considers as the ranging data of each pixel. 

[0039] Thus, since the light which returned from the object object in the 
luminescence period to luminescence of one luminescence to a degree by setting up 
the exposure timing mutually shifted with frames can surely be received, if 
measurable distance is seen in time of flight, it will become long by the luminescence 
OFF period to the luminescence period from a luminescence period. Since time 
amount (henceforth fall-time difference) D1T from the time amount (henceforth a 
rise-time difference) D11 from the start of a transmitted pulse to the start of a 
receiving pulse and the fall of a transmitted pulse to the fall of a receiving pulse is 
measured and those averages are made into a ranging value, highly precise ranging 
becomes possible. 

[0040] Drawing 1 1 is the block diagram showing the 2nd modification of an 
image-processing circuit. In image-processing circuit 34c, the picture signal SG 
outputted from the image pick-up area sensor 22 is changed into image data DG by 
A-D converter 401, and is written in a frame memory 411,412,413 in order for every 
frame. When image data DG of a frame (n+3) is outputted from A-D converter 401, 
from a frame memory 41 1, image data DG of the frame (n) from a frame memory 413 
is outputted [ image data DG of a frame (n+2) ] for image data DG of a frame (n+1) 
from a frame memory 412, respectively. By the divider 421,422,423, the division of 
the pixel unit of image data DG outputted from each frame memories 411-413 and 
image data DG of the frame (n+3) outputted from A-D converter 401 is done, and 
the ranging data DL are computed about a frame (n) - (n+2) each. Three-dimension 
data are computed based on the ranging data DL of these three frames. Here, a 
system controller 31 shall calculate. 

[0041] On the occasion of calculation of three-dimension data, a travelling period 
D1 1 and the data of two frames in which D1 1' is shown are chosen from the ranging 
data DL of three frames. When for that, a division is explained below. 
[0042] The flow chart of the mode distinction which drawing 12 requires for 
calculation of three-dimension data, and drawing 13 are the wave form charts 
showing the relation between three sorts of modes, and a light-receiving stage. In 
addition, in drawing 1 2 , the frame is described as "F." 

[0043] A system controller 31 reads the ranging data DL of the frame (n) obtained 



by photography of a frame (n) - a frame (n+3) - a frame (n+2) from memory 35 
(#101). And the size relation of the ranging data value in a frame (n) - a frame (n+2) 
is judged for every pixel, and one operation actuation of the modes 1 , 2, and 3 is 
performed according to the result (#1 02— #1 12). 

[0044] Like drawing 13 , about a criteria pixel, the ranging data of a frame (n) 
express the rise-time difference Dref, and the ranging data of a frame (n+1) express 
fall-time difference Dref. It is because the travelling period of an internal optical 
path is fully short compared with luminescence pulse width. Therefore, the ranging 
data of a frame (n) and (n+1) are always used for the operation about a criteria pixel. 
However, the modes 1-3 may be judged like [ pixel / criteria ] a measurement pixel, 
and ranging data may be chosen according to the result. 

[0045] In the case of the mode 1, the ranging data of a frame (n) express the 
rise-time difference D101, and the ranging data of a frame (n+1) express fall-time 
difference D101\ Therefore, the ranging data of a frame (n) and (n+1) are used for 
an operation, each — a frame — it — : being the same — a frame — criteria — a 
pixel — data — applying — subtraction — carrying out — things — D — 101 - 
Dref — expressing — having amended — ranging — data — and — D — 101 — ' - 
Dref — ' — expressing — having amended — ranging — data — obtaining — 
having . Let the average of these amended ranging data be ranging data in the 
measurement pixel judged to be the mode 1. 

[0046] Similarly, in the case of the mode 2, calculation and the averaging operator of 
the amended ranging data showing D102-Dref and D102'-Dref are performed using a 
frame (n+1) and the ranging data of (n+2). In the case of the mode 3, calculation and 
the averaging operator of the amended ranging data showing D103-Dref and 
D103-Dref are performed using the ranging data of a frame (n) and (n+2). 
[0047] When performing long distance measurement as mentioned above, by shifting 
exposure timing by inter-frame, resolution increases and highly precise ranging 
becomes possible so that the exposure period of each frame may be made shorter 
than a luminescence period like drawing 14 and multiple times may be exposed 
during a luminescence period (pulsed light projection period) on the appearance 
assumed that two or more frames are simultaneous. In instantiation of drawing 14 , a 
ranging value is calculated using the ranging data showing the rise-time difference 
D1 1 of a frame (n), and the ranging data showing fall-time difference D1 1' of a frame 
(n+3). 

[0048] Moreover, also when performing long distance measurement, the effect of 
ambient light can be reduced. Drawing 15 is drawing showing the outline of the 4th 



modification of control. Frame (n) At - (n+2), intermittent luminescence is performed 
and intermittent exposure is performed to the timing which is the same as 
luminescence or was overdue. With a frame (n+3), luminescence is stopped, 
intermittent exposure is performed and ambient light data are obtained. With a frame 
(n+4), in order to obtain reflection factor data, intermittent luminescence and 
continuation exposure are performed. With a frame (n+5), luminescence is stopped 
and continuation exposure is performed. 

[0049] Drawing 1 6 is the block diagram showing the 3rd modification of an 
image-processing circuit. In 34d of image-processing circuits, measurement data DG 
of a frame (n+2), (n+1), and (n) is memorized by the frame memory 411,412,413. If 
the ambient light data of a frame (n+3) are outputted from A-D converter 401, 
synchronizing with it, read-out of frame memories 41 1-413 will be performed, and an 
ambient light component will be removed by the subtracter 431,432,433. The 
measurement data of the frame (n+2) by which the ambient light component was 
removed, (n+1), and (n) is written in a frame memory 414,415,416. 
[0050] Next, if the reflection factor data of a frame (n+4) are memorized by the 
frame memory 41 1 and the ambient light data of a frame (n+5) are outputted from 
A-D converter 401 , an ambient light component will be removed from the reflection 
factor data of a frame (n+4) by the subtractor 431. Synchronizing with the data 
output from a subtractor 431, read-out of frame memories 414-416 is performed, 
and the ranging data DL of the frame (n+2) which removed the ambient light 
component by the operation in a divider 431,432,433, (n+1), and (n) are obtained. 
[0051] [Example of everything but optical system] drawing 1 7 is drawing showing the 
modification of optical system. In this drawing, the same sign as drawing 1 is given to 
the component corresponding to an above-mentioned example. 

[0052] In the configuration of this drawing (a), it is condensed by the collector lens 

13 and the polarization mirror 17 at the principal point of the light-receiving lens 21, 
and the light which the light source 11 injected faces to the object object Q. 
Incidence of the reflected light from the object object Q is carried out to the 
predetermined pixel of the image pick-up area sensor 22 through the light-receiving 
lens 21, the quarter-wave length plate 16, and the polarization mirror 17. The 
polarization mirror 17 reflects perpendicular polarization and penetrates parallel 
polarization. The quarter-wave length plate 16 leans polarization 45 degrees. 
[0053] In the configuration of this drawing (b), it is condensed with the collector lens 

14 and a half mirror 18 at the principal point of the light-receiving lens 21, and the 
light which the light source 1 1 injected faces to the object object Q. Incidence of 



the reflected light from the object object Q is carried out to the predetermined pixel 
of the image pick-up area sensor 22 through the light-receiving lens 21 and a half 
mirror 18. 

The [2nd operation gestalt] The laser beam is suitable as a signal medium in ranging 
of a TOF method. However, since measurement of an optical travelling period deals 
with a high-speed event, it is difficult for it to secure high degree of accuracy by 
short-distance measurement. By using a TOF method and a triangulation method 
properly, it cannot be concerned with distance but ranging of fixed precision can be 
realized. 

[0054] [Configuration of equipment] drawing 18 is drawing showing the configuration 
of the three-dimension input unit concerning the 2nd operation gestalt. In addition to 
the same component as the three-dimension input unit 1 mentioned above, the 
three-dimension input unit 2 has the concentration gradient filter 19 for triangulation, 
the filter controller 38, and a mode switch 39. 

[0055] The function of the concentration gradient filter 19 is adjustable, and can be 
substantially considered [ performing 1st and 2nd floodlighting from which 
luminous-intensity-distribution distribution differs and ] as a through condition 
(homogeneity luminous intensity distribution). A mode switch 39 is a user interface 
for an operator to direct the change in long distance mode / short-distance mode. 
However, not only a manual change but a simple ranging sensor may detect a near 
distance, and the mode may be switched automatically. According to the mode 
setting signal Sm which a mode switch 39 outputs, a system controller 37 gives 
predetermined directions to the filter controller 38. 

[0056] When long distance mode is specified, the concentration gradient filter 19 is 
controlled to irradiate the object object Q mostly at homogeneity, and ranging of the 
same TOF method as the three-dimension input unit 1 is performed. The actuation 
when short-distance mode is specified is as follows. 

[0057] [Actuation of short-distance mode] drawing 19 is the explanatory view of the 
measurement principle in short-distance mode. As shown in this drawing (a), the 
property of the concentration gradient filter 19 is made into the property that the 
quantity of light changes along one direction (the direction of Y) in a perpendicular 
field to an optical axis. 

[0058] In a frame (n), it floodlights using the concentration gradient filter 19, and 
continuation exposure is photoed. In the continuing frame (n+1), a photograph is 
taken as a condition which rotated the concentration gradient filter 1 9 1 80 degrees 
centering on the optical axis. By this, the floodlighting intensity ratios of a frame (n) 



and a frame (n+1) will differ in all include angles on the basis of an optical axis, as 
shown in this drawing (b). 

[0059] Whenever [ incident angle / of the light which the distance H and each pixel 
of each pixel of the image pick-up area sensor 22 and the light source receive ], 
alpha is known and is a floodlighting intensity ratio, beam-ofHight include-angle 
thetaa, thetab, and thetac. — Correspondence relation is also known. Therefore, by 
asking for the intensity ratio of the incident light in a frame (n) and a frame (n+1) 
about a certain pixel shows the include angle (instantiation thetab) of the beam of 
light which irradiates the point q on the object object corresponding to the pixel. 
Based on this thetab, the distance Lq to Point q is computed in the way of 
triangulation. The image-processing circuit 34 does the division which obtains an 
optical intensity ratio, and a system controller 37 performs the distance operation 
about each pixel. The obtained ranging data are recorded and displayed. 
[0060] In the above 1st and 2nd operation gestalt, using the image pick-up area 
sensor 22 in which color photography is possible, a three-dimension input and a 
two-dimensional color picture input may be performed, and both may be recorded or 
displayed. Although explanation of operation was given as what obtains the 
three-dimension image of one sheet, it is also possible to repeat measurement and 
to perform the three-dimension input of a dynamic body. The image pick-up area 
sensor 22 with a logarithmic-compression function may be used. 
[0061] 

[Effect of the Invention] According to invention of claim 1 thru/or claim 12, it is 
small and the three-dimension input unit of a high resolution can be realized. 
According to invention of claim 11, the range which can input request precision is 
expandable. 
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[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the configuration of the three-dimension input unit 
concerning the 1 st operation gestalt. 

[Drawing 2] It is the explanatory view of a measurement principle. 

[Drawing 3] It is drawing showing the basic configuration of an image-processing 

circuit. 

[Drawing 4] It is the explanatory view of a CCD sensor of operation. 

[Drawing 5] It is the signal waveform diagram showing control of the light 



emitting/receiving at the time of using a CCD sensor. 

[Drawing 6] It is the explanatory view of an MOS mold sensor of operation. 
[Drawing 7] It is the signal waveform diagram showing control of the light 
emitting/receiving at the time of using an MOS mold sensor. 

[Drawing 8] It is the signal waveform diagram showing the 1st modification of control. 
[Drawing 9] It is the^ block diagram showing the 1st modification of an 
image-processing circuit. 

[Drawing 10] It is drawing showing the 2nd modification of control. 

[Drawing 11] It is the block diagram showing the 2nd modification of an 

image-processing circuit. 

[Drawing 12] It is the flow chart of the mode distinction concerning calculation of 
three-dimension data. 

[Drawing 13] It is the wave form chart showing the relation between three sorts of 
modes, and a light-receiving stage. 

[Drawing 14] It is drawing showing the 3rd modification of control. 
[Drawing 15] It is drawing showing the outline of the 4th modification of control. 
[Drawing 1 6] It is the block diagram showing the 3rd modification of an 
image-processing circuit. 

[Drawing 1 7] It is drawing showing the modification of optical system. 

[Drawing 18] It is drawing showing the configuration of the three-dimension input 

unit concerning the 2nd operation gestalt. 

[Drawing 1 9] It is the explanatory view of the measurement principle in 

short-distance mode. 

[Description of Notations] 

Q Object object 

22 Image Pick-up Area Sensor 

33 Timing Controller 

1 5 Internal Optical Path 

19 Concentration Gradient Filter (Optical Means) 
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